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ABSTRACT 

The  time-optimal  control  functions  for  sample  control  systems  were 
computed  using  the  iterative  computational  procedure  proposed  by  L.  W. 
Neustadt  as  adapted  for  differential  analyzer  solution.   The  computational 
procedure  investigated  was  developed  from  the  method  of  steepest  ascent. 
Adaptation  for  differential  analyzer  solution  required  that  finite 
sized  steps  be  taken  during  the  ascent  vice  the  infinitely  small  sized 
steps  permissible  in  theory.   This  presented  one  of  the  problems  of  the 
computational  procedure.   No  optimization  of  the  step  size  was  attempted 
in  this  work,  however,  several  criteria  for  the  selection  of  the  step 
size  were  used  with  success  on  the  two-dimensional  systems. 

The  optimal  control  functions  for  two-dimensional  systems  were 
readily  computed  using  Neustadt' s  iterative  computational  procedure. 
Analytic  work  was  performed  to  verify  some  computer  solutions.  Agreement 
of  computer  and  analytic  solutions  was  favorable.   The  optimal  control 
function  for  the  three-dimensional  system  investigated  was  not  obtained. 
After  sixty  iterations  th ?re  was  no  apparent  convergence  to  an  optimal 
control  function.   Some  refinement  of  the  computational  method  used  in 
this  work  would  be  required  to  extend  the  problem  solutions  to  higher 
order  systems.   No  work  was  performed  to  determine  the  effect  computer 
errors  would  have  on  problem  solutions. 


I .   INTRODUCTION 

There  has  been  an  abundance  of  literature  written  concerning  the 
classical  control  problem,  i.  e.,  given  a  control  system,  assumed  to  be 
normal,  such  that 
(1-1)       x=  A(t)  x  +  B(t)  u 
where;    x  represents  an  n-dimension  state  vector 

A(t)  represents  an  n  x  n  matrix,  not  necessarily  constant 

B(t)  represents  an  n  x  r  matrix,  not  necessarily  constant,  and 

u  represents  the  r-dimension  control  vector 
what  is  the  optimal  control,  u°,  which  will  drive  any  arbitrary  state  of 
the  system,  x(tn),  to  some  specified  final  state,  x(t^),  in  the  minimum 
time.   It  is  well  known  that  the  desired  control  law  is  bang-bang  and 
is  of  the  form 

(1-2)       u  =  sgn  (BT(t)  XT(t0,t)  yj) 
where:    yj  represents  an  n-dimension  constant  vector 

X(t  ,t)  represents  an  n  x  n  matrix  satisfying: 
X  =  Aft)  X  ,  where  X(t0,tQ)  =  I 
Assuming   ||  Uj_  ||   ^  1,  where  u^  are  the  components  of  "u,  then  let 
o(    =  BT(t)  XT(tQ,t)^  ,  then  (sgn  5*  )±   -  +1,  <*  %    >  0,  (sgn  c<  )±   =  -1, 
o<  i  <  0,  and  (sgn  c<  ) .   is  undefined  for  o< \  =  0. 

Lucien  Neustadt  published  a  method  for  the  synthesis  of  the  control 
function  which  was  adaptable  to  analog  computer  and  digital  computer  solution, 
refer  to  L.  W.  Neustadt,  "Synthesizing  Time  Optimal  Control  Systems,"  Journal 
of  Math.  Analysis  and  Applications,  vol.  1,  pp.  h$h-k93,   1963.   For  the  research 


study  reported  in  this  paper,  the  proposed  method  was  adapted  for  analog 
computer  solution,  and  the  regulator  problem,  x(t  )  =  0,  for  three  2-dimension, 
time  invariant  systems,  a  neutrally  stable  system,  a  stable  system,  and  a 
lightly  damped  system,  as  well  as  one  3-dimension,  time  invariant  system  were 
investigated  with  some  analytic  work  developed  to  aid  in  the  problem  analysis. 

The  computational  procedure  for  the  above  mentioned  systems  as  adapted 
for  analog  computer  solution  can  be  briefly  outlined  as  follows:  given  a 
control  system  as  described  by  equations  (1-1)  and  (1-2),  define 
(1-3)      J  -  XT(tQ,t)  ^ 
then 

(i-l;)     j  =  -AT(t)  j,  j(o)  =  yj 

Take  some  initial  guess  for  rj    such  that  Yj   •  x(0)  4  0,  solve  this  set 

of  equations  to  obtain  j"(t)  from  which,  using  equation  (1-2) 

(1-5)      u  =  sgn  (BT(t)  J(t)) 

Now  form  the  function 

(1-6)     t(\,1f)   -  *f  '  Cfttj,^)  +  x(0)) 

where  by  definition 


(1-7)      z(t1,^)=  J   X(t0,s)  B(s)  sgn  (BT(s)  XT(tQ,s)^)  ds 


0 
so  that  r. 

(1-8)      f(t1,f)  =   I    ||yfT  X(tQ,s)  B(s)  ||  ds  +  >?."x(0) 

Determine  the  stopping  time,  t, ,  from  the  zero  crossing  of  f  (t-,  ,  Y) )  for 
t  =  t,  when  f(t-,,>f)  =  0.   Now,  0  <  t,  ^  t-j°  ,  where  the  time  t^  is 
the  minimum  time  to  drive  the  system  to  its  null  state.   Obtain  the  next 
trial  value  of  rj   from  the  correction  vector 
(1-9)     Ay}  =  («(t  ,^)  +  x(0))Ar 
where  z(t,  ,Y|)  is  obtained  by  solving 
tl-10)     f=A(t)y+B(t)u,?(0)-0 


up  to  the  time  t, ,  and  then,  solving  backward  in  time 

(1-11)       w  =  A(t)  w  ,  w(tx)  =  y(tx) 

which  yields 

(1-12)       w(0)  =  t(tx) 

As  long  as  there  is  a  correction  vector,  a  new  trial  vector  Yj    may  be 

used  to  make  t,  approach  t,  °  and  y^  to  approach  ~yj  °  where  YJ  ° 

is  the  constant  vector  which  yields  the  optimum  control  vector  u°. 

The  outlined  procedure  can  be  adapted  to  the  more  general  problem, 
however,  the  computer  capacity  required  would  necessarily  be  considerably 
extended.  For  this  investigation  of  the  general  suitability  of  the 
computational  method  involved,  it  was  decided  to  first  investigate  only 
the  more  simple  types  of  problems  already  mentioned. 


II.   STATEMENT  OF  THE  PROBLEM 

Given  a  control  system,  assumed  to  be  normal,  with  constant 
coefficients  and  a  single  input,  1)  determine  the  optimum  control  law 
on  the  differential  analyzer  using  an  iterative  technique  proposed 
by  Lucien  Neustadt,  2)  investigate  the  influence  of  the  initial 
choice  of  the  constant  vector  rj   ,  3)  investigate  the  effect  of  the 
size  of  the  sampling  interval  AT  ,  and  k)   determine  whether  or  not, 
for  finite  values  of  AT:   ,  the  constant  vector  yj    might  leave  the 
domain  of  yj  ,  i.  e.,  whether  or  not  r>    •  "x(O)  >  0  for  any  iterative 
value  of  V) . 


Ill .   DISCUSSION 

The  solution  to  the  classical  regulator  problem  as  researched  for 
this  paper  follows  with  minor  exceptions  the  method  presented  by  Lucien 
Neustadt  (Journal  of  Mathematical  Analysis  and  Applications,  vol.  1, 
pp  Jj8[t-li93).  Given  a  control  system  such  that 
(III-1)       x  =  A(t)  x(t)  +  B(t)  u(t) 
where:    A(t)  represents  an  n  x  n  matrix,  continuous  function  of  time 

B(t)  represents  an  n  x  r  matrix,  continuous  function  of  time 

x(t)  represents  the  n-dimension  state  vector 

u(t)  represents  the  r-dimension  control  vector 
what  is  the  optimum  control,  u°(t),  which  will  drive  the  system  from 
any  arbitrary  state,  xftg),  at  time  tQ  to  some  desired  final  state, 
x(tn  ),  at  time  t-,    in  the  minimum  time.   It  is  assumed  that  the  admiss- 
ible control  is  magnitude  limited,  |u. |  ^  1,  and  that  the  system  is  a 
normal  system.  A  system  is  normal  if  any  component  of  B^(t)  xT(tQ,t)yi  =  0 
on  any  finite  interval  of  time,  O^t^cO  ,  implies  >o  =  0,  where   "to 
is  an  n-dimension  constant  vector  and  X(t,tfj)  is  the  n  x  n  transition 
matrix  for 

(III-2)       x   =  A(t)  x(t) 
satisfying  the  equations 
(III-3)       X(t,tQ)  =  A(t)  X(t,tQ) 

(Ill-It)       X(t0't0)  =  T 

For  such  a  normal  system  the  optimal  control  is  unique  and  is  bang-bang 

with  ui(t)  ■  ±1,  where  the  sign  is  given  by 


(Ill-*)      u(t)  =  sgn  (BT(t)  xT(t0,t)^ 


The  solution  for  the  system  of  equations  described  in  (III-l)  is  given  by 
(III-6)     x(t)  =  X(t,t0)  x(t0)  ♦  X(t,t0)  J     X(tQ,s)  B(s)  u(s)  ds 

so  that  for  x(t)  -  0 

f  * 

(III-7)     -x(tQ)  =      X(tQ,s)  B(s)  u(s)  ds 


Define  the  subset  C(t): 
(III-8)      C(t) 


s)  B(s)  u(s)  ds  ,  u(s)  admissible  b 


where  C(t)  has  the  properties: 

1)  compact  and  convex 

2)  C(t)  D  CCt^  whenever  t  >  tx 

3)  C(t)  grows  continuously  with  time 

For  t  =  t-j0,  -x(0)  €.    CCt-j0)  and  is  a  boundary  point  of  CCt,0).  Since 
C(t^°)  is  a  convex  set  there  is  at  least  one  row  vector,  Y]T?  such  that 
(III-9)      -  rj   •  x(0)  >  ^  -co  ,  for  all  Zo  £    C^0) 
Thus  Tj  •  oO  takes  on  its  maximum  value  when  cO    -   -x(0),  see  Figure  III-l 
for  a  two-dimension  example. 


Compact  Set  C(t  °) 
Figure  III-l 


Now   oo     e    C(t  °),   so  that 


(111-10) 
and 

(111-11) 


X(tQ,s)  B(s)   u(s)   ds   ,       |  uj    ^    1 


r+  o 
ti 


^  T 


yj  l  X(t   ,s)   B(s)  u(s)   ds   ,     |  u.  |    ^   1 


so  to  maximize     rj  ♦  oo     ,   so  that    y?    •  cJ       =  -  v^   .  x(0),    let 
(111-12)  Ujl  =  sgn   (BT(t)  xT(tQ>t) ^ 

Mow  define 


(111-13) 


■(t^t ) 


t- 


X(tQ,s)  B(s)  sgn  (BT(S)  xT(t0,s)r?)  ds 


so  that  z(t  , ^ )  is  on  the  boundary  of  C(t  ),  see  Figure  III-2.  According 
to  equation  (III-9) 

(III-lii)       V    •  «(t1,^)  >  f?  •  J  ,  for  all  j  £  0(^)5 
J  *  zit^rj)   and  the  function  v?  •  "z(t  ,  vf)  is  a  non-negative,  non- 
decreasing  monotonic  function  of  time. 


Compact  Set  C(t  ) 
Figure  III-2 

Assuming  the  origin  can  be  reached  in  some  time,  t  °,  so  that  -x"(0) 
lies  on  the  boundary  of  the  set  C(t.°),  there  is  a  convex  set  of  vectors, 
Hq,  such  that  if  ^  £  Hq,  -  yj"  •  x(0)  maximizes  the  function  y\    •  vJ      for 
00     £     C(t.°)  and  -x(0)  ="z(t  °,  ^").   Consider  the  function 


(III-X5)    f(t,T?  jx(0))  =  >?  •  (z(t,^)  +  x(0)) 

Now  by  definition,  z(t  ,  I]  )  =  0,  so  restrict  Yj    such  that 

(111-16)    f(tQ,v?  jx(0))  <  0 

If   if  ^    H  ,  f(t10,^   ;x*(0))  >    0,  hence  for  some  time  t   ,   0  ^  t    ^   t  °, 

(111-17)         f(t19Yl    ;x(0))  =  0 

Let 

(111-18)         F(T),x(0))   =   tx 

so  that 

(111-19)         f(F(7f,x(0)),v?  jx(0))  =  0 

Since  f(F(v?  ,x(0)),  V)  jx(0))  is  continuous  in  its  arguments,  F(vi,x(0)) 

must  be  continuous  in  "v^  so  that  if  ^  ^  H  ,  F(Tt",x(0))  ^  t   and  if 

*f  S     H0,  F(yj  ,x(0))  =  t-j0.  Thus  any  vector  rj   such  that  V)  •  *x(0)  ^  0, 

which  maximizes  the  time  t,,  for  which  Y^  •  (z(t-^frj )   +  x(0))  =  0 

where  z(t,,vj)  is  given  by  equation  (111-13)  may  be  used  in  the  optimum 

control  function.  Conversely,  if  v]  defines  the  optimal  control  function 

it  maximizes  the  time. 

To  solve  for  Yj  use  the  method  of  steepest  ascent.  Assume 
(111-20)    ij  =  rj(t) 
then 

(111-21)    d^/dt  -k  VF(yJ,"x(0)) 

where  k  >  0  is  some  constant  or  function  of  TT  and  V| .  In  order  to 
obtain  a  valid  solution: 

1)  F(vj  ,x(0))  must  have  a  maximum  for  YJ° 

2)  the  solution  Y^(f )  never  leaves  the  domain  of  F(T|,x(0)),  and 

3)  the  partial  derivatives  %n,     exist,  where  Ti.    are  the 
components  of  Y). 

Proceeding  formally,  see  Neustadt's  work  for  statements  of  proof, 

from  equation  (111-19),  given  a  specified  initial  state,  3c(t  ), 

0 


where  F(>?  ,x(0))  —    t,   is  given  implicitly  by  (II 1-19).     Then 
(111-23)         v*F--(Jf/|£) 


but 


(III-2U)         j|  =   ("(^,^7)  +  x(0» 


ii  ,    i_/    (  t    II  *Tfmy  tT/ 


and 

(111-2$)          5f  -     ^(    j         ||BT(s)  XT(t0,s)^||ds: 

0 
so  that 

(111-26)  VF  »  -(zk(t1,V])   ♦  x(0))/  ||      BT(t)  XT(tQ,t)  Vf|| 

From  equations   (111-18)   and    (111-20), 

(111-27)  F  =  F(  \\  (  f)) 

hence 

let 

(HI-29)         ^=    ||'BT(t)  XT(to,t)^||     VF 

then 

(111-30)        || -  -(t(tltr\)  +±(Q)) 

so  that  finally 

(III-3D  ^   =     ^  -(l(t  ,^)   +  x(0))  dt,     T)2   -    fll  =  dv^ 

To  compute  this  corrected  vector,  "n  ,  it  is  necessary  to  precompute 

z(t^,  Y]    )   for  which  in  turn  it  is  necessary  to  precompute  the  time  t,. 

Thus  it  is  seen  that  "z(t,  ,^7-1)  is  not  an  instantaneous  function  of  time 

and  a  finite  sampling  interval,  AT"    ,  is  required,  hence  equation  (II 1-31) 

becomes 

(111-32)    y\2   =  y^  -  (z(t1?  vj1)  ♦  x(0))  AT 

The  time  t,  was  defined  by  equation  (111-17)  and  z(t   ,y[   )   is  given  by 

equation  (I 11-13 )  so  that  we  have 


(111-33)     rj      •"z(t1,:YJ1)  -J    >j  T  X(tQ,s)  B(s)  sgn  (BT(s)  XT(to,s)^)  ds 

0 


or  using  the  steering  command  given  by  (I 11-12) 

(III-310    \  'H(%v  *!{)   -  j1   |bT(s)  XT(t0,s)  v^  J]  ds 

Now  let 

(111-35)    j(t)  =  XT(tQ,t)^1 

then 

(111-36)    J  =  -AT(t)j(t)  ,  j(tQ)  =  ^ 

Solving  equation  (111-36)  then  gives  t (t)  from  which,  together  with 

equations  (lll-l£),  (111-17)  and  (III-3U) ,  it  becomes  possible  to  compute 

the  time  t^.  See  Figure  III-3  for  a  block  diagram  description  of  the 

computing  technique.  As  revealed  in  Figure  III-3,  the  control  signal 

given  by  equation  (I 11-12)  is  easily  developed  at  the  same  time. 

Now  with  the  time  t  known  it  becomes  possible  to  compute  z(t  ,  \i    ). 
Consider 
(111-37)    y  «  A(t)  y(t)  +  B(t)  u(t)  ,  y(0)  =  0 

which  has  the  solution 

f* 

(111-38)    y(t)  =  X(t,t  )      X(t  ,s)  B(s)  u(s)  ds 
0  J   tQ     0 

which  combined  with  equations  (111-12)  and  (111-13)  yields 

(111-39)    j(\)   -  X(tlttQ)  "ft^f^) 

or  alternately 

(iii-ao)  tit^rj^   =  x-1(t1,t0)f(t1) 

where  X~  (t  ,t  )  is  the  transition  matrix  for 
(III-UI)    ^  =  A(t)  w(t)  ,  Tr(t  )  =  yft  ) 
run  backwards  in  time  so  that 
(III-242)    t(tQ)    =  J-1^,^)   y^) 

-  t(t1,^1) 
See  Figure  III-I4  for  a  computational  block  diagram  for  the- function  z(t  ,  Yj  ), 
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IV.    COMPUTER  DESCRIPTION  AND  CIRCUITRY 

The  analog  computer  used  in  the  research  of  this  paper  was  the 
Michigan  twenty  amplifier  computer.  The  amplifiers  had  a  gain  of 
100,000  to  1.  Amplifiers  were  not  drift  stabilized,  however,  accurate 
balance  was  accomplished  through  use  of  a  0,1  volt  full  scale  deflection 
voltmeter.  Resistors  were  matched  to  provide  an  accuracy  of  0.1$  and 
capacitors  were  variable  and  adjusted  to  provide  matched  outputs. 
Twenty-three  ten  turn  helipots  plus  a  three  gang  helipot  were  set 
against  a  null  helioot  to  provide  accurate  potentiometer  settings. 
Individual  problems  were  set  up  on  removable  patch  boards. 

In  addition  to  the  basic  computer,  a  four  place  digital  volt- 
meter was  used  to  read  out  voltages.  Automatic  hold  switching  was 
accomplished  by  using  relays  in  external  circuitry. 

The  circuits  presented  in  this  section  were  developed  for  the 
general  two-dimension,  single  input  system: 
(IV-1)      x   =  A(t)  x(t)  +"b(t)  u(t)  ,  |u|^l 
The  three-dimension,  single  input  system  circuitry  requires  little 
modification  and  will  not  be  presented  in  this  section.   For  multiple 
input  systems,  a  normalization  scheme  other  than  the  one  used  in  this 
work  would  be  required.   The  specific  circuitry  for  each  problem 
analyzed  is  presented  under  the  appropriate  sub-section  in  Section  V. 

Given  the  system  described  by  equation  (IV-1),  the  adjoint  set 
of  equations  is  given  by 

(iv-2)    f  -  -AT(t)  j,  3(0)  mij 


13 


where 

(IV-3)     AT(t)  = 

The  circuits  required  for  the  solution  of  this  set  of  equations  are 


all   a21 
a12   a22 


simple  integration  circuits  as  presented  in  Figure  IV- 1,  where 
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Pj_  ■  potentiometer  setting 

R.  =  input  resistance,  ohms  x  10° 

Cp<  =  capacitance,  farads  x  10"° 

cxi      =   ephysical  quantity 

e   evoltage  representation 


o<£     -   "freal  ti 


lme 


t   ^computer  time 


(1*40      BT(t)  XT(tQ,t)7f  =  BT(t)  J 

or  for  the  single  input  system 

(IV-5)      BT(t)  xT(tQ,t)  ^  =tT(t)"S 

a  simple  summing  circuit  as  shown  in  Figure  IV-2  is  required  for  the 

solution  of  the  set  of  equations  given  by  equation  (IV-£),  where 


and 


P     -     -> 

N         «*Ti 

Fl 

°<BT(t)  xT(t0,t)^ 

Pa  ="6 
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For  the  single   input  system 

(17-6)  ||  BT(t)  XT(tQ,t)  vf||     =  |  BT(t)  XT(tQ,t)  yj\ 

hence  the  absolute  value  circuit  presented  in  Figure  IV- 3  was  used 

to  normalize  the  scalar  quantity.  To  normalize  a  vector  quantity  a 

different  scheme  would  be  required.   The  absolute  value  circuit  is  an 

extremely  accurate  circuit. 

Now  then  r 

-  -    I   Xll  II 

(IV-7)      V  *  "        BT(s)  XT(t  ,t)yf   ds 

Solution  of  this  equation  requires  a  simple  integrating  amplifier, 

see  Figure  IV-li,  where 

.        P<BT(t)xT(tn>t)^ 
7    7  F3    cX^,-*  *it 

By  putting  the  initial  condition  equal  to  +  "Vj  •  x(0)  on  the  amplifier 
the  function  f(v?  ,"zjx(0))  can  be  obtained  directly.   To  obtain  the 
stopping  time,  run  the  system  until 

f(^,zSx(0))  =  0 
at  which  time  switch  to  hold.  Automatic  hold  switching  was  obtained 
through  use  of  a  relay  as  depicted  in  Figure  IV-£.  To  insure  accurate 
switching,  the  voltages  were  read  out  to  four  decimal  places,  an 
adjustable  input  was  supplied  to  the  amplifier  as  shown  in  Figure  IV-5 
and  stopping  times  which  satisfied  f (  y?  ,"z;x(0))  =  ±0.0005  volts  were 
accepted. 

Time  was  generated  on  a  simple  integrating  amplifier  with  constant 
input.  When  the  computer  was  run  in  reverse  time  the  input  voltage 
was  reversed  in  polarity  and  the  automatic  hold  circuit  was  switched 
to  the  output  of  the  time  generating  amplifier.  Again  the  system 
was  automatically  switched  to  hold  at  time  t  ■  0. 
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The  control  signal  was  produced  by  taking  the  output  of  amplifier 
number  3,  Figure  17-2,  and  feeding  that  into  the  bang -bang  circuit 
presented  in  Figure  IV-6.  The  potentiometer  is  adjusted  to  produce 
the  voltage  representation  of  the  magnitude  of  the  control  signal. 
The  voltage  potential  of  two  common  outputs  will  be  that  of  the  most 
positive  of  the  individual  amplifiers.  At  point  A  the  voltage  will  be 
the  most  positive  value  of  1)  +  saturation,  2)  -  saturation  or  3)  u  =  -1 
which  automatically  eliminates  2)  as  a  possibility,  since  if 
BT(t)  XT(tQ,t)>)  >  0,  -1  >  -  saturation  and  if  BT(t)  XT(tQ,t)  vf  <  0, 
+  saturation  >  -1  >  -  saturation.  Similarly  at  point  B  the  voltage 
represents  u  m   +1  for  BT(t)  XT(tQ,t)  ^  >  0,  or  u  =  -1  for  BT(t)  XT(t0,t)  ^  <  0, 
This  is  an  extremely  accurate  circuit  for  which  the  voltage  representation 
for  u  was  set  accurately  to  four  significant  figures.   The  switching 
time  was  determined  to  be  less  than  0.1  milliseconds  for  an  input 
changing  at  the  rate  of  5>0  volts/sec  which  was  chosen  as  a  representative 
rate  of  change  of  the  voltage  representation  of  BT(t)  XT(tQ,t)  v^. 

The  circuits  used  to  compute  z(t  ,  rj  )   were  simple  integrator 
circuits.  First  j(tj)   was  computed,  see  Figure  IV-7,  from 
(IV-8)      y  -  A(t)  y  ♦  b(t)  u  ,   y(0)  -  0 
and  then  z(t  ,  y\  )  was  computed  by  integrating 
(IV-9)     w=A(t)w   ,  w(t1)=y(t1) 
backward  in  time,  see  Figure  IV-8,  to  yield 
(IV-10)     *(t,,^")  -  w(0) 

To  perform  the  backward  integration,  it  was  only  necessary  to  reverse 
the  polarity  of  all  the  inputs  to  the  integrators  used  in  the 
generation  of  y(t  )  and  remove  the  control  signal  input,  all  of 
which  was  accomplished  by  manual  switching  while  in  the  hold  condition. 
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In  Figure  IV- 7, 

Po     =    RnC 
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V.   SPECIFIC  PROBLEM  SOLUTIONS 


Selected  two-dimension  as  well  as'  one  three-dimension  system  were 
investigated  for  the  research  of  this  paper.  The  two-dimension  systems 
investigated  were: 

1)  a  neutrally  stable  system,   3c=^  M       "x+\^(u   ,  |  u|  ^  1 

x  ♦    [0]    u       ,     |  ,  |  «    1 


2 )  a  stable  system,      "x  = 

3)  a  lightly  damped  system  , 


and  the  three-dimension  system  investigated  was: 


h) 


0  10 
0  0  1 
0     0     0 


0 

0  [    u        ,     I  u  I 


Plant  1)  was  chosen  to  provide  a  System  on  which  a  rather  thorough 
analytic  solution  could  be  obtained  in  an  effort  to  gain  some  insight 
into  the  problem  solution.  Plant  2)  was  chosen  to  investigate  the 
effect  of  running  a  stable  plant  in  reverse  time,  that  is  a  stable 
and  an  unstable  combination.   Plant  3)  was  chosen  as  a  representative 
two-dimension  system  for  which  solution  might  be  desired.   The  three- 
dimension  plant  U)   was  selected  to  provide  a  simple  extension  of  the 
computational  procedure  to  higher  order  systems. 
Plant  1) 

The  analytic  solution  to  the  control  problem  synthesis  parallels 
the  analog  computer  solution.   Given 


(V-l) 

define 

(V-2) 

where 

(v-3) 


0       0 
-1       0 


°j       n        ,     |u|    S    1 
J    >       7(0)   =   \  - 


^11 

^12 


3  =  xT(t0,t)>)1      ,    x(t0,t0) 
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then 

(V-li)  BT(t)  XT(tQ,t)    y]1  =  tTJ    =  -v^t  +    t)12 

from  which 

(V-5)  u  ■  sgn   (->7i:Lt   +    yj      ) 


and 


(v-6)         y\    . 


"^ll3  +  ^12l      dS 


Referring  to  Figure  V-l,   for   V]        and   Y]        of  the   same  sign 
(V-6  A)  >?!'"£-       h12|      t   -    |T/U|t?    ,      t   4   ^i2AU 


(v-6  B)         >7X  -t  -  -|yj12|  t  ♦    hn|  A    ,     t  ^  Y]12/y]ii 

and  for    "^-q  anc*    ^ip  °^  opposite    signs 

2 
(v-6  c)         7]1  •  t  =    |y)i2|    t  +  |Y|     I  X  ,    %  &    o 


Now 


(V-7)  f(^1,^;x0)   -  0 


where  Xq  =  x(0) 


(V-7  A)  t 


defines  the  time  t     implicitly.     From  (V-6  A) 


[xOl]     , 

^-(hj2^!^!  (^nx01   ^12x02)) 


n 


n1 


from  (V-6  B) 

(V-7   B)  t     =   '^X2I    llKgj 


2Kll   (v)llX01+V)  12*02     +  M^r)d)) 


and  from   (V-6  C) 


i*iui 


(V-7   C)  t     =      '    '12' 

1  n- 


(|>g  2  -  2ln1Tl  (^ux01  *  v)12x02  +  l^KJ))* 


By  definition 
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3T/„>  VT/ 


(V-8)      z(t1,^1)  =  J    X(tQ,s)  B(s)  sgn  (B^s)  X^t^s)  ^)  ds 
but 


(V-9)      X(0,s) 


1    -s 
0     1 


(V-10)     z(t 


l'"fy  =  Jo   ^  ^   Sgn  ("^11  3  +  ^  dS 
that  for  t  ^  ^io/^ii*  and  ^-n  and  "Hip  of  the  same  siSn 

2i* 
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•(t,2)/2  sgn   (Y|12) 
(V-10  A)         ¥(t   ,n    )  m     < 

for  t1  ^    V)12/Y7n»  and    ^2.1  and   ^12   of  the  same  sign 

(V-10  B)        ~z(t1,l]1)  *    H(M,)*39*  W  "  4<V/%)  59^  fv,,,)    +■  t4    ^*  K)  > 

and  for  Y)   and  Y]       of  opposite  signs 
'11      '12     \1   , 

_    _*      ((0/2  sgn  (y;   ) 
(V-10  C)    z(t1,Yl  )  p  j   1         /U 
(_  -tx  sgn  (Y)n) 

Now 

(V-ll)      ^1  =  .^,^)  +^) 

and 

(V-12)     Av]i  =  gl  ^r 

so  that 

(v-13)     ^  =  Y?.  -  (ftly^  -  xQ)  A^r 

With  this  computational  procedure,  successive  values  of  Y}  were  obtained 

for  AT  =  1,  "x  =  j  i  £  .  The  data  are  presented  in  Table  V-l  and  a  plot 

of  y)       versus  Yi   is  presented  in  Figure  V-2.  From  equations  (V-7)  it 

is  apparent  that  t,  is  a  function  of  only  one  variable.  To  gain  a 

better  understanding  of  the  function  F(rj  ,x0)  on  which  the  method  of 

steepest  ascent  was  used,  it  was  decided  to  find  F(/3  )  where  P    =  Y)     /  Tj      , 

Then  for  ^  4  Y]12/Y]n>  ^n  and  ^12  the  same  sign 
(V-1U  A)    tx   -  P  -   (  f>2  -   2(xQ1  ♦  P   xQ2))2 

for  t^  Y?l2//T)ll,  ^n  and  ^12  the  Same  Sign 

(V-ll*  B)    tx  =  P+   (-P2   ♦  2(xQ1  +/>x02))* 

and  for  Y)        and  Y]        of  opposite  signs 

(V-ll*  C)         tx  -    /°  *   (/? 2  +  2(x01  +    P  xQ2))* 

F(7]_,x0)  was  plotted  versus  P   in  Figure  V-3. 

The  effect  of  the  size  of  Af  was  investigated  by  linearizing  equation 

(V-13)  about  *t\0   =  )"■*">  which  was  obtained  from  Figure  V*-3.  Since  Vj 
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and    Y>       <    0  and  t     >   y),o/Y)ln>  using  equations   (V-10  B)  and   (¥-13) 


i+1 
define 


(vis)      1°-\+1-V  4^ 


then  for  i0^[j]     ,^°  -   [^j 


(V-16) 

6  - 

A    c£^ 

where 

(V-17) 

A  = 

(1  -  2  AT) 
2&t 

(i  ■ 

2  Af 

•2At) 

The   eigenvalues  of  A  are 

(V-18) 

>    - 

i,  i  -  liAtr 

] 


For  stability,  |  ?\ .  |  <  1,  hence  for  the  given  plant  with  ~x  =  /   f 
AtT  <  0.50  gives  stability.  As  noted  in  Table  V-l  and  Figure  V-2 
with  AT  =  1  there  is  a  slight  divergence  in  the  successive  values  of 
V]  as  v^  u  was  approached. 

Using  the  circuitry  presented  in  Section  IV  as  combined  in  Figure  V-U, 
the  computational  procedure  was  investigated  for  values  of  At'  =  1.0, 
0.375,  0.2^  and  0.1  with  Xq  =  (J"j   .  The  data  for  the  iterations  are 
presented  in  Table  V-II  and  are  plotted  in  Figures  V-2,  V-5,  V-6  and  V-7 
respectively  with  the  corresponding  analytically  computed  iterations. 
As  expected  AT    =  0.25,  h   ■  1  and  0,  yielded  the  most  positive  convergence 
to  Yj°f    ATT  =  0.375  gave  rapid  convergence  with  some  oscillations, 
AT     =  0.1  gave  slow  convergence  and  AT    °  1.0  gave  large  oscillations. 
The  hill  climbing  pattern  associated  with  each  value  of  AT    is  presented 
in  Figure  V-8.   It  was  noted  in  Table  V-II  that  as  x  —>  0,  the  correction 


vector  Cz(t1,>71)  +*x.)  At  — *  0  independent  of  the  choice  of  AT  . 
plots  of  x„(t)  versus  x, (t)  are  presented  in  Figures  V-9,  V-10,  V-ll 
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figure   ir-ia         plots     of     /**t     versus    <*, 


V-12  respectively  to  indicate  the  relative  error  in  x(t..  )  for  successive 
iterations  of  yj  •   The  initial  choice  of  V7   =  if   on  ^e  boundary  of 
yJ-  •  x(0)  ^  0  was  chosen  for  At      =  1.0,  for  At    =  0.25  and  0.375, 
vf,  *T=YqT|   was  chosen  and  for  At  =  0,1,  V7  was  arbitrarily  chosen. 
There  was  no  apparent  effect  due  to  this  limited  choice  of  initial  values 
of  v|1. 

The  plant  was  further  investigated  for  another  given  initial  state, 
x(0)  ■  \      ^  (  .   The  plot  of  F(T7  ,x  )  versus  P   is  presented  in  Figure 
V-13.  Again  the  difference  equation  (V-13)  was  linearized  about 


(-0.668  At     +  1)        1.198  Atr 
1.11*2  Ar     (-2.01*7  AT    +  1) 


(V-19)      S    = 

so  that  A  has  the  eigenvalues 

(7-20)      }\    =  1,  1  -  2.715  At 

Analytic  and  computer  computations  for  At"  =  0.1  and  1.0  were  made  and 

the  data  are  presented  in  Table  V-III  and  displayed  in  Figures  V-ll*  and 

V-15.  The  hill  climbing  patterns  are  presented  in  Figure  V-l6.  Again 

AT  =  1.0  gave  oscillations  while  AT"  ■  0.1  gave  slow  convergence,  and 

as  before  as  x(t  )  — >  0,  the  correction  vector,  -OzTt,,^f)  +  ~xQ)  At  -—* 

independent  of  the  choice  of  AX •     The  plot  x_(t)  versus  x,  (t)  is 

presented  in  Figure  V-17  for  AT  =  1.0  to  display  the  relative  error 

in  x(t  )  for  successive  values  of  vy  . 

Plant  2) 

The  computer  was  set  up  as  shown  in  Figure  V-18  using  the  basic 
circuits  of  Section  IV  for 


0 


(V-21)  "x 


-2  1 

0         -1 


x+     [J]     u,      Ju|    ^ 


1 


*0)   -     ft«J    ,       {>?}     ,   ana       [30] 


Initial  states   of  x(0)  =        °'2/    ,       I  3*5 f     ,   and          30  1   were  investigated 
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F/Giute    37-/7        plots  of  /*t  v£*su&  /*, 
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to  determine  the  effect  of  computing  solutions  through  different  multiples 

of  the  system  time  constant. 

For  x(0)  =  j°'2(  »    AT    "  0-5  and  1.0  were  used.  The  data  are 

tabulated  in  Table  V-IV.  Plots  of  Y)       versus  in .   are  presented  in 

Figures  V-19  and  V-20,  the  Xp(t)  versus  x,(t)  plots  are  presented  in 

Figures  7-21  and  V-22,  and  the  plots  of  7«(t)  versus  y^(t)  and  Wp(t)  versus 

W]_(t)  are  presented  in  Figures  V-23  and  V-2k   to  indicate  the  range  of 

y[t)   and  w(t)  in  the  computation  of  z(t  ).  As  was  the  case  with  Plant  1), 

At  ■  1.0  gave  some  oscillations  and  relatively  slow  convergence,  whereas 

AT     =0.5  gave  much  more  rapid  convergence  and  eliminated  much  of  the 

oscillations.  Again  it  was  noted  that  as  x(t, )  — >   0,  the  correction 

vector  ~(t(tlfyj)   +~x.n)AV   — >    °  independent  of  the  choice  of  AT  • 

For  x(0)  =  {3«!>i  ,  the  choice  of  AT"  was  dependent  upon  the 
I  0  J 

criterion  |a^.  -,|   <C   |a^-|  •  The  data  are  tabulated  in  Table  V-IV, 

the  Yi.   versus  7).,  plot  is  presented  in  Figure  V-26.   Using  this  criterion  for 

the  selection  AT   rapid  convergence  with  some  oscillation  was  obtained. 

Again  as  the  state  vector  x(t, )  — ^  0,  the  correction  vector 

-(z(tl9-YJ)   +  "x*Q)AT  >  0. 

For  x(0)  ■  \       [      the  choice  of  AT  was  dependent  upon  the  criterion 
AvJi+1  *  A>]i>  0.  The  data  are  presented  in  Table  V-IV,  the  Y). 
versus  Y).      plot  is  presented  in  Figure  V-27,  the  x  (t)  versus  x  (t)  plot 
is  presented  in  Figure  V-28  and  the  plots  of  y?(t)  versus  y1(t)  and  w?(t) 
versus  w..(t)  are  presented  in  Figure  V-29.  It  is  noted  from  Table  V-IV 
that  the  additional  requirement  that  vj  ♦  Xq  ^.  0  was  used  in  the  selection 
of  AT,  hence  using  the  finite  difference  equation  it  does  become 
possible  for  Y)   to  leave  the  domain.  In  Figure  V-29  it  is  noted  that  the 
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range  of  y(t)  is  much  smaller  than  the  range  of  w(t).  Any  noise  in  the 
system  would  have  a  more  pronounced  effect  on  y(t)  resulting  in  errors 
in  y(t  )  and  hence  in  z(t  ).   This  could  possibly  explain  why 
-(zt"^,^)  +  x0)y^  0  as  x"(t  )  — >   0.   This  problem,  or  source  of 
probable  error,  could  be  minimized  by  rescaling  the  amplifiers  used  to 
compute  y(t)  and  w(t)  when  switching  from  forward  time  to  reverse  time, 
or  by  using  separate  amplifiers  to  compute  the  two  functions. 

The  only  analytic  work  performed  for  this  plant  was  the  computation 
of  the  time  t  and  the  results  are  presented  in  Table  V-V.  As  can  be 
seen  from  the  table,  there  is  good  agreement  in  all  cases  between 
the  analytic  and  computer  values  of  the  time  t  . 

Table  V-V 
Comparison  of  Analytic  and  Computer  Values  of  the  Time  t-. 


Initial  state 

analytic 

computer 

x(0)  .      ft?} 

0.6U 
1.55 
2.1*9 

0.6Ui9 

l.51i9 

2,1*63 

Plant  3) 

The  computer  was  set  up  as  shown  in  Figure  V-30  using  the  basic 

circuits  of  Section  IV  for 

(V-21)      x  =  [  J    _  1   x  +  foj   u  ,  |u|  <  1 

Initial  states  of  x(0)  =  \M       7(    and  |6(  were  selected  to 

provide  systems  requiring  differing  numbers  of  control  signal  switching, 

The  criterion  used  for  the  selection  of  AT   was  An   .,  •  A  V7  .  >  0 

'l+l      fi 

for  all  three  initial  states.   The  data  are  presented  in  Table  V-VI, 
the  plots  of  Yi       versus  Yi   are  presented  in  Figures  V-31,  V-32, 
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and  V-33  respectively  for  the  three  given  initial  states  and  the  plots 
of  X2(t)  versus  x-^ft)  are  presented  in  ^igures  V-31+,  V-35,  and  V-36.  In 
all  three  cases  the  convergence  to  ^°   was  rapid  and  x(t  )  and 
(z(t  ,  r)  )   +  x  )  were  of  the  same  order  of  magnitude  as  "n  — >  rt°. 

Plant  It) 

The  computer  was  set  up  as  shown  in  Figure  V-37  using  the  basic 
circuits  of  Section  IV  modified  for  the  three-dimension  system 


0  10 
0  0  1 
0  0  0 


0 
0  t 


(V-22)      x  - 

x(0)  =  Si)      was  the  initial  state  which  was  investigated.  Initially 

the  criterion  for  the  selection  of  AV     was  that  A>7.  ,  •  Av-     ^  ^> 

however,  after  seven  iterations  it  was  decided  to  use  as  the  criterion, 

At"     which  would  yield  tn    >  tn     Using  this  criterion,  a  total 
max  -L-i+l     M. 

of  sixty  iterations  were  completed  at  which  time  x(t  )  />   0  and 
z(t,)  -/->   -x(0).  The  data  for  iterations  fifty  through  sixty  are 
presented  in  Table  V-VII.  There  was  no  apparent  pattern  for  the  selection 
of  ^t*.  In  all  iterations  it  was  possible  to  duplicate  values  of  t, 
for  successive  re-iterations  with  the  same  computer  parameters;  it  was 
not  possible  to  duplicate  values  of  z(t  ).  With  this  in  mind  some  error 
analysis  work  is  indicated  to  determine  the  effect  of  an  error  in  z(t-|_), 
introduced  by  some  random  signal,  has  on  the  convergence  to  vf  °. 
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VI.   SUMMARY  OF  RESEARCH  RESULTS 

The  optimum  control  law  for  two-dimension  systems  is  readily- 
obtained  using  Neustadt's  synthesis  technique  as  adapted  to  analog 
computer  solution.   For  the  solution  of  three-dimension  and  higher 
order  systems  some  refinement  of  the  computer  technique  used  in  this 
research  is  necessary. 

The  initial  choice  of  v?  has  relatively  little  effect  on  the 
convergence  to  the  optimum  steering  order.  There  are  a  wide  variety 
of  criteria  for  the  selection  of  At  which  in  general  lead  to 
satisfactory  results  for  the  two-dimension  system.   For  design 
of  an  automatic  system  perhaps  the  criterion  that  A  r^  •    A  yj  .     )>  0 

would  be  the  best  suited.  In  general  large  values  of  AT   give  slow 
convergence  with  large  oscillations  about  >t"°  while  small  values  of 
At  give  slow  positive  convergence.  There  obviously  are  some  At" 
which  give  the  best  convergence  but  no  optimization  was  attempted 
in  this  research  work. 

Using  the  finite  difference  equation  in  computing  iterative 
values  of  Y}    it  becomes  possible  for  *]    to  leave  the  domain. 
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VII.   POSSIBLE  EXTENSIONS  OF  THIS  RESEARCH  WORK 

1.  The  natural  extension  of  this  work  is  to  continue  on  into 
the  third  and  higher  dimension  systems. 

2.  A  significant  extension  of  this  work  would  be  the  optimization 
of  AT. 

3.  An  error  analysis  of  the  effect  random  errors  in  the  computation 
of  z(t-.  )  has  on  the  convergence  to  vf  °  would  be  noteworthy. 

k»     To  be  of  maximum  use  the  system  must  be  fully  automatic, 
utilizing  logic  circuits,  and/or  a  digital-analog  combination  which 
subject  requires  some  investigation. 
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